Section 1: Information about the file -¶
- Total records (RangeIndex)
Out[20]:
- Number of Columns (Data Columns)
Out[21]:
- Column Names and Data Type
Out[22]:
Section 2: Snapshot of the data -¶
Does the data contain any empty cell?¶
True - Yes
False - NoOut[24]:
Identify duplicate records¶
Based on the combination - District+Janpad+Gram Panchayat+Village+Name of head of household+GOI ID
Section 3: Data Error Checks¶
1. Total Duplicate records:¶
In [26]:
"""Data Error Condition 1: Number of Duplicate Records identified using Duplicate Key above"""
raw_data_dup = raw_data[raw_data["is_duplicate_record"] == True]
raw_data_dup.shape[0]
Out[26]:
Deduplicating the data
Number of unique Records -
Out[27]:
2. Missing Data in Mandatory Columns:¶
Observations:¶
a. All the values in Column_1 are missing. b. There is no other missing value error.
3. Number of records where toilet is available in the household but type of toilet has either not been provided or mentioned as not available -¶
4. Number of records where toilet is not available in the household but type of toilet has been mentioned -¶
5. Number of records where toilet is not available in the household but reason for not using it is mentioned -¶
Total Households Surveyed in Reverification of Toilet:¶
Out[32]:
Households by Economic Status¶
Observations:¶
- 58.16% of the households where toilet is not usable belong to BPL category.
Households by Social Category¶
Households by Economic Status and Social Category¶
Observations -¶
- There are 18.88% households in "Others" category
- All the General category households are BPL
- BPL Households has only General, SC and ST category. No landless family, or household headed by a woman or physically challenged person has been reported as BPL.
Observations:¶
- 43% of the housheolds surveyed for unusable toilet has reported that they don't have toilet i.e. 4.36 lakh such households are there
Availabilty of Different Types of Toilet across Households¶
Reasons for Not Using the Toilet¶
Observation:¶
Major reasons for no usage of toilet is the superstructure defect
- 54% of the households having toilet are not using it due to lack of or broken Pit.
- 40% of the households having toilet are not using it in lack of a door.
- 36% of the households having toilet are not using it due to lack of or broken Platform.
- 34% of the households having toilet are not using it due to lack of toilet seat.
- 28% of the households having toilet are not using it due to lack of water.
Prominent reasons for no use of toilets across in districts, janpad and gram panchayats¶
In [47]:
raw_data.pivot_table(index=['District','Janpad','Gram Panchayat'],
values=['Total Household',
'No Toilet Seat',
'Water Seal Not Connected to Toilet Seat',
'No/Broken Platform',
'No Water',
'Used as Animal Shelter',
'No Wall',
'No Door',
'No Chamber',
'Pit Full',
'No/Broken Pit',
'No Cap',
'Used as Storage',
'Used for other purpose',
'No Reason'],
aggfunc={'Total Household':np.sum,
'No Toilet Seat':np.mean,
'Water Seal Not Connected to Toilet Seat':np.mean,
'No/Broken Platform':np.mean,
'No Water':np.mean,
'Used as Animal Shelter':np.mean,
'No Wall':np.mean,
'No Door':np.mean,
'No Chamber':np.mean,
'Pit Full':np.mean,
'No/Broken Pit':np.mean,
'No Cap':np.mean,
'Used as Storage':np.mean,
'Used for other purpose':np.mean,
'No Reason':np.mean},
margins=True).apply(lambda x: round(x*100,2))
Out[47]:
Availability of Toilets and Water Source in the Households¶
Observation:¶
- Handpump is the major source of water in households (46% of households use handpumps)
- Water Supply scheme is available in only 15% of the households.
- 18.5% of the households rely on wells
- Around 87 Thousand households having toilets has no water source
Section 3: Status of toilets across State and Districts¶
Out[51]:
Observations¶
- Jabalpur and Morena has nearly 67% of the households without toilet
- Sehore and Agar Malwa are the two districts with highest % of households without any source of water (nealry 16%). These two districts also have highest proportion of households having toilet but no water source.
Section 4: List of Distribution of Households¶
Number of duplicate records region wise
In [52]:
dup_hh=raw_data_dup.pivot_table(index=["District","Janpad","Gram Panchayat"],
values='Total Household',
aggfunc=np.sum).sort_values('Total Household', ascending=False)
create_download_link(dup_hh,filename="Toilet Not Usable - Duplicate Records.csv")
Out[52]:
Household Toilet Status
In [53]:
hh_tnu_tlt_status = raw_data.pivot_table(index=['District','Janpad','Gram Panchayat'],
values=['Total Household',
'% Headed by Women',
'% Headed by Person with Disability',
'% Having No Toilet',
'% Having No Water Source',
'% Households having Toilet but no Water Source'],
aggfunc={'Total Household':np.sum,
'% Headed by Women':np.mean,
'% Headed by Person with Disability':np.mean,
'% Having No Toilet':np.mean,
'% Having No Water Source':np.mean,
'% Households having Toilet but no Water Source':np.mean},
margins=True)
create_download_link(hh_tnu_tlt_status,filename="Toilet Not Usable - Household Toilet Status.csv")
Out[53]:
Households by Socio Economic Condition
In [54]:
hh_by_sco_eco=raw_data.pivot_table(index=["District","Janpad", "Gram Panchayat"],
columns=["Economic status", "Sub-category"],
values=['Total Household'],
aggfunc={'Total Household':np.sum},
margins=True)
create_download_link(hh_by_sco_eco,filename="Toilet Not Usable - Households by Socio Economic Condition.csv")
Out[54]:
List of Households Not Having Toilet
In [55]:
hh_no_tlt=raw_data[raw_data['Has Toilet']!="हाँ"].pivot_table(index=["District",
"Janpad",
"Gram Panchayat",
"Village"],
values='Total Household',
aggfunc=np.sum).sort_values('Total Household', ascending=False)
create_download_link(hh_no_tlt,filename="Toilet Not Usable - Households not having toilet.csv")
Out[55]:
Number of records where toilet is available in the household but type of toilet has either not been provided or mentioned as not available
In [56]:
raw_data_tlt_nttype.pivot_table(index=["District","Janpad","Gram Panchayat"],
values='Total Household',
aggfunc=np.sum).sort_values('Total Household', ascending=False)
create_download_link(raw_data_tlt_nttype, filename="Toilet Not Usable Error - Type of toilet not provided.csv")
Out[56]:
Number of records where toilet is not available in the household but type of toilet has been mentioned
In [57]:
raw_data_ntlt_ttype_pv=raw_data_ntlt_ttype.pivot_table(index=["District","Janpad","Gram Panchayat"],
values='Total Household',
aggfunc=np.sum).sort_values('Total Household', ascending=False)
create_download_link(raw_data_ntlt_ttype_pv,filename="Toilet Not Usable Error - No Toilet but Type Mentioned.csv")
Out[57]:
Number of records where toilet is not available in the household but reason for not using it is mentioned
In [58]:
raw_data_ntlt_nrsn_pv=raw_data_ntlt_nrsn.pivot_table(index=["District","Janpad","Gram Panchayat"],
values='Total Household',
aggfunc=np.sum).sort_values('Total Household', ascending=False)
create_download_link(raw_data_ntlt_nrsn_pv,filename="Toilet Not Usable Error - Toilet not used but no reason.csv")
Out[58]: